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Abstract 

It is shown in this paper that the quantum master equation can be mapped 
to a modified continuous time random walk (CTRW) if the relaxation term 
is composed of transitions over a set of states. When the Hamiltonian is 
time-independent and transitions are between its eigenlevels, such a modified 
CTRW reduces to the Markovian walk equivalent to the Pauli master equa- 
tion. On the other hand, the memory in such a modified CTRW is composed 
of a temporal factor and the probability determined by the Liouville flow 
when the relaxation term is reduced as a special dephasing term. 
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I. INTRODUCTION 



Random walks are important to the analysis in stochastic processes. [1-3] Many physical 
phenomena can be mapped to random walks. It was shown that for some nonMarkovian 
stochastic processes, we shall consider the continuous time random walk (CTRW). [1,4,5] In 
such a generalized random walk, the probability density r{l,t) for the walker to reach state 
I at time t is governed by 

r{l, t) = Y, f dt'ij{l', I, t - t')r{l', t') + s{l, t) (1) 

when t > to. Here the memory ijj{l'J,t — t') presents the probability density to make a 
single transition to state I at time t after reaching I' at time f, and the nonnegative real 
function s{l,t) presents the source term. In a CTRW, the transition probabihty from I' to I 
can depend on how long the walker stays at I'. The memory of the CTRW should satisfy 

j2 1 dm',i,t-t')^i (2) 
I 

so that the walker will make another transition after reaching any state For the CTRW 
starting at state Iq at time t = ti, we shall set s{l,t) = Si^i^Sit — ti) and to = ti. The Pauli 
master equation [6] 

t)^Yl '^viP{l\ ^) - wii,p{l, t) (3) 
at ^, ^, 

equivalent to a Markovian random walk, in fact, can be mapped to a CTRW with 

r(Z,t) =Z«;,,,p(r,t) and (4) 
v 

l,t- t') = wi'iexp[-{t - t') Z wi'i"] 

I" 

if J2i"Wi'i" > for all [1] as shown in Appendix A. Here p{l,t) is the probability to find 
the walker at I at time t, and the nonnegative coefficient wi'i is the rate for the transition 
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On the other hand, for the time evolution of a quantum system described by the (positive) 
density matrix p{t) with 

trp{t) = 1, (5) 

it was shown that a (quantum) relaxation term should be included in addition to the Liouville 
flow if the system is in contact with the reservoir. [7-14] Let H{t) be the hermitian operator 
for the Liouville flow. The density matrix p{t) is governed by 

d d 

— p(t) = i[p{t), H{t)] + — p(t) \relaxati<m, (6) 

where ^p{t)\reiaxation is the (quantum) relaxation term. When §ip{t)\reiaxation = 0, the 
above equation is reduced to the (quantum) Liouville equation. [7] In this paper, we take 
the constant = 1, and define [C, B] ^ CB - BC and {C, B} ^ CB + BC for any two 
operators B and C. If in Eq. (6) we set the relaxation term as the Lindblad form [7,12] so 
that 

^^p{t)\relaxaUon = E[-^{P(^)' ^-V^,} + Vlp{t)V^] (7) 

with {Vm} is a set of operators, the postivity of p{t) is preserved under Eq. (6). [7,8] If the 
relaxation term is composed of transitions over a set S in which each state n corresponds 
to a normalized ket \n), we shall set Vm — w]l^,\n){n'\ for the transition from n to n' and 
replace the index m by (n, n') , where Wnn' > presents the transition rate. Then Eq. (6) 
becomes 

^p{t)=i[p{t),H{t)]-{p{t),A} + J2wnn'\n'){n\p{t)\n){n'l (8) 

nn' 

where 

>i-E^I^)H (9) 

nn' 

presents the imaginary part of the self energy. [10] In many cases, H{t) — Ho + V{t) with Hq 
and V{t) as the unperturbed and the perturbed part, and S is composed of the eigenstates 
oiHo. [9-11] 



In this paper, it is shown in section II that Eq. (8) can be mapped to a modified CTRW 
over S if we define 

A''\n,t)^J2^n'n{n'\p{t)\n') (10) 

n' 

as the probabihty density for the walker to reach n at time t. (It is not necessary to set S as 
an orthogonal or a complete set in section II.) In such a modified CTRW, we indroduce the 
memory ip^'^\n' ,t' ,n,t) for the probability density to make a single transition to n at time 
t after reaching n' at time t'. In comparison with the memory of a CTRW, '4>'''^\n' ,t' ,n,t) 
depends on both t and t' rather than t — t', the time the walker wastes at the state n' before 
jumping to n. If H{t) = Hq as a time-independent Hamiltonian and S is composed of the 
eigenstates of Hq, after calculations we have 
d 

— {n\p{t)\n) = Y,i'^n'n{n'\p{t)\n') - Wnn'{n\p{t)\n)] (11) 

n' 

from Eq. (8). Comparing with Eq. (3), we can see that the above equation is just the Pauli 
master equation after replacing n and {n\p{t)\n) by / and p{l,t), respectively. Therefore, 
from Eq. (4) we can sec that the definition of A''\n,t) is natural. On the other hand, when 
-§lP{t)\reiaxation IS rcduccd as a purc dephasing term under which all phases have the lifetime 
r, the memory ip^i\n', f, n, t) of the modified CTRW becomes 

-e-('-''y^\{n\U(t,t')\n')\'. (12) 

T 

Here the unitary operator U{t,t') satisfies i§-^U{t,t') = H(t)U{t,t') and U{t\t') = /, the 
identity operator. The factor \{n\U{t,t')\n')\^, in fact, is just the probability for being \n') 
at time t' to jump to \n) at time t under the Liouville flow. These two examples and some 
questions are discussed in section III. Conclusions are made in section IV. 

II. QUANTUM MASTER EQUATION AND RANDOM WALK 



To relate Eq. (8) to a modifled CTRW, note that the density matrix p{t) governed by 
Eq. (8) satisfies 
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Pit) = E rrfiV«'(^,OG^(i,OI^)(^|Gt(^,0 + G^(^,^o)p(to)Gt(t,to), (13) 

as shown in Appendix B. Here the operator G{t,t') satisfies 

i^Git,t')^{Hit)-iA)G{t,t') (14) 

when t > t' and G{t',t') — I. To prove Eq. (13), in fact, we just need to take the time 
derivative on both sides of Eq. (13) and check the initial condition because Eq. (8) is a 
first-order differential equation with respect to t. Inserting Eq. (13) into the right hand side 
of Eq. (10), we have 

r(i\n,t) =E f dt'ij^'^\n',t',n,t)A'^\n',t')+s^'^\n,t) (15) 

if we define 

i^^^\n',t',n,t) ^ Y.^r^"n\{n"\G{t,t')\n')\' (16) 

n" 

and 

s^'>\n,t) ^ J2^n"n{n"\Git:to)p{to)G\t,to)\n"). (17) 

n" 

In comparison with Eq. (1), Eq. (15) can be taken as the equation for the modified CTRW 
equivalent to Eq. (8) if s*^*^ (n, t) and ip^'^^ {n', t', n, t) can serve as the source term and memory, 
respectively. It is easy to see that '^^'^\n' ,t' ,n,t), and s^'^\n,t) are nonnegative from their 
defintion. 

To take ^^'i\n' ,t' ,n,t) as the memory for the transition probability density, we need to 
prove that the probability to make another transition after reaching n' at time t' cannot be 
larger than 1 for all n' and t'. That is, J2n liT dtip^'^^ (n', t', n, t) < 1 for all n' and t'. To prove 
it, note that 

i-Tr[G\t, t')G{t, t')Q] = -2Tr[QG\t, t')AG{t, t')] (18) 
ot 

for any (timc-indcpcndcnt) positive hermitian operator Q whose trace is well-defined. Be- 
cause Z]„'0^^^(^')^')^)^) — '^Tr[QG'^{t,t')AG{t,t')]\Q=\n'){n'\ after some calculations, we have 
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^lim Yl j, dtij^'^\n' ,t' ,n,t) ^ lim / 2Tr[QG\t,t')AG{t,t')]\Q=^n'){n'\dt (19) 

= - lim Tr(Gt(^,^')G(t,t')|n')(n'|)|*Z^ 
= 1- lim ||G(r,0|n')ir<l. 

1 — >oo 

Since 'ijj^'^\n' ,t' ,n,t) > 0, limr_,oo /J ^^'0*^^^^') ^> ^) well-defined and we can take 
1 — liuiT-trxJ^n dt'il^'^^\n' ,t' ,n,t) as the probability to be trapped in n' after reaching it 
at time t'. 

For s^i\n,t), we have En^^^H^^^) = 2Tr(QGt(i^ ^0))!^^^^^^^ after calculations 
and hence from Eq. (18), it is easy to prove that J2n dts^'^\n,t) < trp{to) — 1. We can 
take s^''\n, t) as the probability density for the walker to start at state n and at time t, and 
1 — J2n It^ dts^"^^ (n, t) as the probabihty for the walker not to walk over S. 

Prom the above proof, therefore, we can map Eq. (8) to a modified CTRW. 

III. DISCUSSIONS 

In the last section, we have mapped Eq. (8) to a modified CTRW. When H{t) — Hq as a, 
time-independent Hamiltonian and the set S for transitions are composed of the eigenstates 
of Hq, the memory ip^''\n', t', n, t) defined in Eq. (16) can be reduced as Wn'n^ 
The calculations are easy because now the states in 5" can be used to diagonalize both Ho 
and A. Replacing n by Z, in such a case ■0^^^ is just the memory for the Pauli master equation 
as that defined in Eq. (4), which is reasonable because we have the Pauli master equation 
from Eq. (8). 

On the other hand, when Wnn' ^n,n' /t and 5" is an orthonormal complete set, the opera- 
tor A defined in Eq. (9) reduces to ^ because En 1^) (^1 = I- Now G{t, t') = U (t, t')e~'^*~*')/^'^ 
after calculations and hence ^^'^\n',t',n,t) is reduced as that in Eq. (12). The factor 
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\{n\U{t,t')\n')\'^ in Eq. (12) is just the probability for being \n') at time t' to jump to \n) at 
time t under the Liouville flow if at t we perform a (quantum) measurement [7] under which 
the system becomes a state in S. But it should be emphasized that we are discussing a sys- 
tem in contact with the reservoir and ■^'^^^ is not obtained directly from assumptions about 
(quantum) measurements [7]. (In fact, suitable relaxation terms are used for "continuous 
quantum measurements". [16,17]) The factor ie~'^*~*'^/'^ is induced by A which presents the 
imaginary part of the self energy. Since ^{n\p{t)\n)\reiaxation = in such a case, there is no 
transition over S due to this relaxation term. But for phases, i.e. the off-diagonal terms of 
pit) in the expansion with respect to we have 

d 1 

-^{n\p{t)\n')\relaxatian = --{n\p{t)\n'), (20) 

where n ^ n' . Therefore, such a relaxation term induces the decay of phases without 
inducing transitions and is a pure dephasing term [10]. This pure dephasing term is a 
special case of the relaxation term in Eq. (7), so it will not break the positivity of p{t). 
[7,8] If we include an arbitrary pure dephasing term, however, the positivity of p{t) may be 
broken in general. [13,14] 

It is proved that En Iv" d^^'^^n' , t\ n,t) <1 and En It7 dts^^^n, t) < trp{to) = 1 in the 
last section. If S is an orthonormal complete set and there is a positive real number c so 
that 

Wnn' > c (21) 

n' 

for all n, and we can prove that Y.nJ^ dt^^'i\n\t\n,t) = 1 and En It7 dts^'^\n,t) = 
trp{to) — 1. This is because in Eq. (18), 

2Tr[QG\t,t')AG{t,t')] (22) 
> cJ2{n\G{t,t')QG^{t,t')\n) 

n 

= cTr[G\t,t')G{t,t')Q] 
7 



if Eq. (21) holds. Prom Eqs. (18) and (22) we have §^Tr[G''{t,t')G{t,t')Q] < 
-cTr[G^{t,t')G{t,t')Q], and hence 

hm Tr[G\t, t')G{t, t')Q] < lim e-^^^'^'^TrQ = 0. (23) 

Inserting Eq. (23) into Eq. (19) with Q = \n'){n'\, we can complete the proof for V'^*^- The 
proof for s^'^^ is similar. Therefore, if Eq. (21) holds and S is an orthonormal complete set, 
there is no probability for the walker not to walk or not to make the next transition. But 
ijj^'^^n', t', n, t)\n=n' may be not zero and hence the walker may stay at the same state under 
a transition. The random walk with the memory defined in Eq. (12) is equivalent to Eq. 
(8) when Wnn' 5n,n' /t ^ud S as an orthonormal complete set, and we can set c— l/r for 
such a walk to satisfy Eq. (21). 

For a quantum system composed of many identical noninteracting particles, usually pit) 
presents the one-body density matrix. So we do not use Eq. (5) to normalize p{t), but 
set trpit) as the number of particles. For a dilute system, we can still use Eq. (8) to 
include transitions in addition to the Liouville flow. [13,14] Because Eq. (8) is linear, it 
is unimportant how to normalize p{t) when we map Eq. (8) to a modified CTRW. Now 
r^^^(n, t)Ai presents the expected number of particles to enter the orbital n in the time 
interval (t, t + At) as At — > 0. If the system is not dilute, however, in general Eq. (8) should 
be modified, as shown in Appendix A. The modified equation in Refs. 13 and 14, in fact, 
can be obtained by substituting 

A\t) = E ^[(1 - a{n'\p{t)\n'))\n){n\ + a{n\p{t)\n)\n') {n% (24) 

nn' 

for A in Eq. (8), where the constant a = 1 for fermions and a = —1 for bosons. Then Eq. 

(8) becomes 

^p{t) = i\p{t). H{t)] - E (1 - a{n'\p{t)\n'))\n){n\ + a{n\p{t)\n)\n'){n'\} + (25) 

nn' 

^Wnn'\n'){n\p{t)\n){n'\. 

nn' 
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As shown in Appendix C, the positivity of p{t) is still kept and for fermions {a\p{t)\a) < 1 
for any normalized \a). The above equation, however, is nonlinear and in general it is not 
expected that we can map the above equation to a random walk. But A'{t) can be reduced 
to A when Wnn' — Wn'n and we can still map such a case to the modified CTRW. 



In this paper, it is shown that the quantum master equation can be mapped to a modified 
continuous time random walk if the relaxation term is composed of transitions over a set 
of states. When the Hamiltonian for the Liouville flow is time-independent and the set is 
composed of the eigenstates of this Hamiltonian, the modified CTRW is just the Markovian 
walk corresponding to the Pauli master equation. On the other hand, if the relaxation term 
is reduced as a special pure dephasing term, the memory is composed of the probability due 
to the Liouville fiow and a temporal factor due to the imaginary part of the self energy. 



The author thanks C. C. Chang for his valuable discussions. 

APPENDIX A 

To prove that Eq. (3) can be mapped to a CTRW, note that the solution y{t) of the 
differential equation 



IV. CONCLUSIONS 
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y{t) = -\y{t) + h{t) with y{to) = yo 



(26) 



is of the form 




to 



(27) 
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where A and i/q are real numbers, and h{t) is a known real function. If in Eq. (3) we set 

p{l,t), Y.i'U!ii', p{l,to), and r{l,t){= Y.v wvip{l' ,t)) as y{t), A, |/o, and h{t), respectively, Eq. 
(3) can be reduced as Eq. (26). Hence from Eq. (27), we have 

p(/, t) = f dt'e-^'-'"> ^i' ^«V(/, t') + e-(*-*°) ^i' "'«'p(/, to) (28) 

Jto 

Inserting the above equation into the right hand side of the first equation in Eq. (4) , we can 
complete the proof. 

On the other hand, as mentioned in section III, in general Eq. (8) should be modified 
when p{t) presents the one-body density matrix of systems composed of many identical 
noninteracting particles. To see this, consider the case that H{t) — Hq asa time-independent 
Hamiltonian and each n in 5" satisfies HqIti) — En\n). (Then {\n)} is an orthonormal 
complete set.) Expanding p{t) by states in S in such a case, from Eq. (8) we can obtain Eq. 
(11) for the diagonal terms. For the phases (off-diagonal terms), we have 

^{n\p{t)\n') = -^{n\p{t)\n') Y^iw^n" + w^'n") + i{En' - E^){n\p{t)\n') (29) 

n" 

for any two different (normalized) kets \n) and \n') e S. (In the above equation, in fact, the 
first term at the right hand side describes the decoherence, i.e. the decay of phases. [9-11]) 
Semiclassically, however, Eq. (3) should be modified as [13-15] 

^p{l, t) = J2[winil - apil, t))p{l\ t) (30) 

-wwp{l,t){l-ap{l',t))i 

which is not equivalent to Eq. (11) in general. Here the constant a equals 1 and -1 for 
fermions and bosons, respectively. In addition, for fermions Eq. (29) should also be modified 
to keep 

{a\p{t)\a)<l (31) 

for any normalized ket \a). [14] But if we modified Eq. (8) as Eq. (25), we have 
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-(n|p(t)|n) = EK'n(l - a{n\p{t)\n)){n'\p{t)\n') (32) 

n' 

-Wnn'{n\p{t)\n){l - a{n'\p{t)\n'))\ 

when H{t) — Hq and S is composed of the eigenstates of Hq. The above equation is just 
Eq. (30) if we replace {n\p{t)\n) and n by p{l,t) and /, respectively. In addition, as shown 
in Appendix C, for fermions Eq. (31) is kept under Eq. (25) for any arbitrary H{t) and S. 
Therefore, the modification is reasonable. 



APPENDIX B 

Consider the time-dependent matrix M{t) = Q{t,t')MQQ\t,t') with the operator Q{t,t') 
satisfying i§-^g{t,t') = {n{t) - iA{t))Q{t,t') Sitt>t' and g{t',t') = 7, where n{t) and A{t) 
are two time-dependent hermitian operators and Mq is an arbitrary operator. When t' is 
just the initial time to, the matrix M{t) is the unique one satisfying 

^M(t) = z[M{t),H{t)] - {M{t),A{t)} (33) 

and M(to) = Mq. If t' is larger than the initial time to and we assume that M{t) = when 
t < t' , the matrix M{t) is the uique one satisfying M(to) = and 

^M{t) = i[M{t),n{t)] - {M{t),A{t)} + S{t) (34) 

with S{t) — MoS{t — t'). Therefore, if S{t) — J2j QjS{t — tj), it is not hard to see that the 
time-dependent matrix 0{t) satisfying 

^0{t) = t[0{t),n{t)] - {0{t),A{t)} + S{t) (35) 

with 0{to) = Oo is 

o{t) = E ^(^' tj)QjS\t^ tj) + s{t, to)Oog\t, to) (36) 

tj<t 
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Here Qj and Oq are arbitrary operators. In the above two equations, we shall replace 
Qj and J2tj<t by dt"Q{t") and //^, respectively, and S{t) = Q{t) in the continuous limit. 
Then we can see that the the solution of Eq. (8) can be written as that in Eq. (13) with 
S(t) ^ j:nn'Wnn'\n'){n\p(t)\n){n'\, n{t) ^ H{t), A{t) ^ A, 0{t) ^ p{t), Co ^ p{h), and 

V. APPENDIX C 

To show that Eq. (25) is a suitable modification, we need to prove that the positivity of 
p{t) is still kept. That is, the equation 

(6|p(t)|6)>0, (37) 

is kept for any ket \b). In addition, for any H{t) and for fermions we need to prove that 
Eq. (31) holds for any normalized \a). Eq, (31), in fact, is equivalent to 

mm < m m 

for any ket \b). The complete proof will be shown in Ref. 14. In the following I just show 
the key points. Redefining G{t,t') by substituting A'{t) for A in Eq. (14), under Eq. (25) 
first we still have Eq. (13) 

Pit) = E f dt'A'^\n,t')G{t,t')\n){n\G\t,t') + G{t,to)p{to)G\t,to). 

Secondly, setting a = 1 for fermions, we have 

p{t) = / - E r dt'R{n, t')G{t, t') \n) {n\G^{t, t') (39) 

-G{t, to)G\t, to) + G{t, to)p{to)G\t, to), 

where R{n, t') = J2n' ''^nn'i^ ~ (^'|p(^)|^'))- To prove the above two equations, we just need 
to check the initial condition and their time derivatives. Assume that p is positive at any 
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time t' < t. If q; = 1, we also assume that {h\p{t')\h) < {h\h) for any ket \h) when t' < t. 
Then at time for any normahzed ket \m) we have 

p{t) = Y: f dt'r^'^\n,t')mm,t,t')\n)\' (40) 

+{e{m,t,toMto)\e{m,t,to)) > 0, 
from Eq. (13), where the ket i{m,t,t') = G^{t,t')\m) for any \m). In addition, for fermions, 
{m\p{t)\m) = (m|m) - V dt'R{n,t')\{e{m,t,t')\n)\'^ (41) 



-[{i{m,t,toMm,t,to)) - {iim,t,toMto)\i{m,t,to))] < (m|m) 

from Eq. (39). We can see from Eqs. (40) and (41) that under Eq. (25), Eq. (38) is kept 
for fermions and the positivity of p{t) is kept for fermions and bosons. 
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